Deep Reinforcement Learning Based Energy Efficient Multi-UAV Data Collection for IoT Networks
نویسندگان
چکیده
Unmanned aerial vehicles (UAVs) are regarded as an emerging technology, which can be effectively utilized to perform the data collection tasks in Internet of Things (IoT) networks. However, both UAVs and sensors these networks energy-limited devices, necessitates energy-efficient procedure ensure network lifetime. In this paper, we propose a multi-UAV-assisted network, where fly ground control sensor's transmit power during time. Our goal is minimize total energy consumption sensors, needed accomplish mission. We formulate problem into three sub-problems single UAV navigation, sensor well multi-UAV scheduling model each part finite-horizon Markov Decision Process (MDP). deploy deep reinforcement learning (DRL)-based frameworks solve part. Specifically, use deterministic policy gradient (DDPG) method generate best trajectory for obstacle-constraint environment, given its starting position target sensor. also DDPG collection. To schedule activity plans visit multi-agent Q-learning (DQL) approach by taking on path account. simulations show that find safe optimal their trips. Continuous achieves better performance over fixed approaches terms addition, compared two commonly used baselines, our framework near-optimal results.
منابع مشابه
Data-efficient Deep Reinforcement Learning
Grasping an object and precisely stacking it on another is a difficult task for traditional robotic control or hand-engineered approaches. Here we examine the problem in simulation and provide techniques aimed at solving it via deep reinforcement learning. We introduce two straightforward extensions to the Deep Deterministic Policy Gradient algorithm (DDPG), which make it significantly more dat...
متن کاملEnergy-Efficient Data Collection in UAV Enabled Wireless Sensor Network
In wireless sensor networks (WSNs), utilizing the unmanned aerial vehicle (UAV) as a mobile data collector for the ground sensor nodes (SNs) is an energy-efficient technique to prolong the network lifetime. Specifically, since the UAV can sequentially move close to each of the SNs when collecting data from them and thus reduce the link distance for saving the SNs’ transmission energy. In this l...
متن کاملA Deep Reinforcement Learning Based Approach for Cost- and Energy-Aware Multi-Flow Mobile Data Offloading
With the rapid increase in demand for mobile data, mobile network operators are trying to expand wireless network capacity by deploying wireless local area network (LAN) hotspots on to which they can offload their mobile traffic. However, these network-centric methods usually do not fulfill the interests of mobile users (MUs). Taking into consideration many issues such as different applications...
متن کاملMulti-Focus Attention Network for Efficient Deep Reinforcement Learning
Deep reinforcement learning (DRL) has shown incredible performance in learning various tasks to the human level. However, unlike human perception, current DRL models connect the entire low-level sensory input to the state-action values rather than exploiting the relationship between and among entities that constitute the sensory input. Because of this difference, DRL needs vast amount of experi...
متن کاملReinforcement Learning with Deep Energy-Based Policies
We propose a method for learning expressive energy-based policies for continuous states and actions, which has been feasible only in tabular domains before. We apply our method to learning maximum entropy policies, resulting into a new algorithm, called soft Q-learning, that expresses the optimal policy via a Boltzmann distribution. We use the recently proposed amortized Stein variational gradi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE open journal of vehicular technology
سال: 2021
ISSN: ['2644-1330']
DOI: https://doi.org/10.1109/ojvt.2021.3085421